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(57)Abstract: 

PROBLEM TO BE SOLVED: To facilitate adjustment of 
a parallax amount of each person in the case of 
photographing and viewing a stereoscopic vision image. 
SOLUTION: The stereoscopic vision image viewing 
system includes a parallax amount storage means that 
stores parallax amounts respectively proper to a 
photographer and a viewer of a stereoscopic vision 
image and each person calls the parallax amount to 
photograph an object and view an image with the 
parallax amount suitable for each person. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1]A compound eye camera which has two or more imaging systems, comprising: 
Holding mechanism holding a value depending on each photography person. 

A selecting means which chooses a value for which a photography person depended on self from 
said holding mechanism. 

[Claim 2]A control means which makes an imaging system of a compound eye camera control in 
a compound eye camera which has two or more imaging systems, A compound eye camera 
making an imaging system of a compound eye camera control by said control means based on a 
value which has holding mechanism holding a value depending on each photography person, and a 
selecting means as which a photography person chooses a value depending on self from said 
holding mechanism, and was chosen by said selecting means. 

[Claim 3]The compound eye camera according to claim 1 or 2, wherein a value depending on 
each photography person held at holding mechanism is a parallax amount of a corporal vision 
picture. 

[Claim 4]A corporal vision observation system which displays a picture for corporal visions on a 
display, and performs a corporal vision, comprising: 

Holding mechanism holding a parallax amount depending on each observer of a corporal vision 
picture. 

A selecting means which chooses a parallax amount for which an observer depended on self 
from sard holding mechanism. 

A positioning means which determines a position displayed on a display based on a parallax 
amount selected by said selecting means. 

[Claim 5]A compound eye camera which has a corporal vision image observation system or a 
corporal vision display which observes a compound eye camera or a corporal vision picture which 
photos a corporal vision picture, comprising: 

Holding mechanism holding two or more parallax amounts depending on each photography person 
or an observer. 

A setting-out means to set up a present photography person or an observer. 

A selecting means which chooses from said holding mechanism a parallax amount depending on a 

present photography person or an observer set up by said setting-out means. 

[Claim 6]A compound eye camera characterized by what a photography person also records 
simultaneously in a compound eye camera which has two or more imaging systems when 
recording a picture. 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the system which observes the corporal vision 

camera and corporal vision picture which photo a corporal vision picture. 

[0002] 

[Description of the Prior Art]The corporal vision image pick-up notation using a compound eye 
imaging device is known from before. This arranges two imaging optical systems right and left at 
the interval to which it is given by base length, and picturizes the picture from two viewpoints. 
[0003]The eye of human being's right and left is averaged, it is supposed that there is distance 
of about 65 mm it, and it has been a standard that the base length of two imaging optical 
systems shall be 65 mm also in a corporal vision image pick-up display. Thus, when a certain 
photographic subject to which its attention was paid is picturized from two viewpoints on either 
side, the positions of the photographic subject in the picture picturized by each imaging system 
differ mutually. That is, this is azimuth difference and the user can see a picture with a cubic 
effect by carrying out stereo ** of this azimuth difference. 

[0004]Various methods are one of the methods of carrying out stereo ** of the picture acquired 
from two viewpoints on either side. One outputs the picture of each right and left alternately 
with right and left on a display, and it obtains a stereoscopic picture in the user side by seeing 
with the liquid crystal shutter glasses which change a shutter on either side synchronizing with 
the change of a display of the right-and-left picture. 

[0005]ln another notation, the picture of the stripe shape which arranges the picture of two right 
and left by turns at intervals of [ horizontal to the field of the corporal vision picture of one 
sheet created beforehand ] a line, and consists of right-and-left 2 picture is created. 
[0006]And the polarization direction has a polarizing plate which changes by turns in the display 
screen at intervals of [ horizontal ] a line like the created corporal vision picture, and a picture 
differs in stripe shape in a polarization direction, and is displayed on it. 

[0007]Then, if the corporal vision picture of the created stripe shape is displayed on this display, 
only the polarization light of only a direction with the picture picturized by the right imaging 
optical system will penetrate, and will be displayed, and the picture picturized by the left imaging 
optical system penetrates only different polarization light from a right picture, and is displayed. 
On the other hand, a user hangs the polarization eyeglass provided with the function which 
penetrates only the same polarization light as the picture displayed on each right and left by the 
display, only the polarization light as which the right image is displayed on the right eye is 
penetrated, and a left eye penetrates only the polarization light as which the left image is 
displayed. Using these glasses, a user is only a right eye about a right image, and can see a left 
image only by a left eye, and the user can see a picture with a cubic effect. 
[0008]By the corporal vision image pick-up display, the azimuth difference of the picture 
picturized from a different viewpoint is used as mentioned above. That is, the user has made the 
picture with a cubic effect by carrying out the fusion so that it may pile up about the 
photographic subject (it is called a main object below) which paid its attention to two pictures 
with azimuth difference. 
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[0009] Generally, when a user does the fusion of the picture of two viewpoints on either side 
about a main object and it carries out a corporal vision, the one where the azimuth difference of 
the main object between right-and-left 2 pictures is smaller can perform the fusion of a main 
object easily, Then, it is necessary to arrange an imaging optical system so that the azimuth 
difference of a main object may become small, when picturizing, 

[0010]In the former, the angle of convergence was given to ** imaging optical system for this 
problem, and it had solved by carrying out parallel translation of the arrangement ** imaging 
optical system, and arranging it. Drawing 2 shows the plot plan of the imaging optical system of 
the corporal vision image pick-up by parallel **, when the imaging optical system has been 
arranged without giving an angle of convergence. 

[0011]The two imaging optical systems 101a and 101b are mutually arranged in parallel at the 
interval given by the base length 1 focusing on the starting point 0, and it has CCD103a and 
103b the lenses 102a and 102b, an image sensor, and here, respectively. The interval of the lens 
102a, CCD 103a and the lens 102b, and CCD 103b is set to v. The position A which left only z in 
the direction picturized from the starting point 0 shall have the main object 104. 
[0012]in drawing 2, the main object 104 carries out image formation to CCD103a of each right 
and left, and 103b with the azimuth difference d (=l-v/z). An angle of convergence is given to the 
imaging optical systems 101a and 101b, and azimuth difference of a main object is made small so 
that a user may tend to do the fusion of this. 

[0013]The angle OAB (theta) which consists of the center of a lens, and the position A in which 
the center B of a left lens and the object 104 exist here and the starting point O in this figure is 
theta=arctan {l/(2z)}. Formula (1 ) 

It is given. As for z, the distance of two imaging optical system groups and objects and I express 
the base length of two imaging optical systems here. Then, C is made into a center of rotation by 
setting two imaging optical systems as the center B of each lenses 102a and 103a r By rotating 
only angle theta from straight-line BC, both the positions of the main object which carries out 
image formation to both CCD103a and 103b (that is, thing for which the angle of convergence S 
of an imaging system is made into S=theta) can be carried out in the center of a picture, and 
azimuth difference can be set to 0. 

[0014]Drawing 3 is a figure which has given and arranged the angle of convergence to the 
imaging optical systems 101a and 101b so that azimuth difference between 2 pictures of the 
main object 104 picturized may be set to 0. 

[0015]As long as there are no physical restrictions of that an imaging optical system collides by 

giving an angle of convergence to the imaging optical systems 101a and 101b as mentioned 

above etc., it is possible to set azimuth difference of the main object 104 to 0. 

[0016]There are methods, such as taking small base length, in the method of carrying out parallel 

translation of the imaging optical system, and on the other hand, arranging it. 

[0017]The plot plan which made base length of the imaging optical systems 101a and 101b small 

to 1 to V is shown in drawi ng 4. If base length of an imaging optical system is made small, 

azimuth difference of the picture of the picturized right and left can be made small. 

[0018]Thus, the compound eye imaging system which adjusts a cubic effect existed by changing 

an angle of convergence and carrying out parallel translation of the imaging optical system. 

[0019] 

[Problem(s) to be Solved by the Invention]However, the parallax amount which senses a 
comfortable cubic effect in a corporal vision has large individual difference. For example, he does 
not so like the picture in which a cubic effect of Mr. A is strong, but it presupposes conversely 
that the strong picture of a cubic effect was Mr. B liking. With the parallax amount adjusted for 
Mr. [ B I when such, when Mr. B observes a corporal vision picture with the parallax amount 
which a cubic effect was too strong or was conversely adjusted for Mr. [ A ] when Mr. A 
observed, a cubic effect may be insufficient and it may be sensed unsatisfactory* 
[0020]Therefore, when photoing and observing a corporal vision picture by two or more persons, 
the parallax amount needed to be acljusted each time so that the person might suit himself. When 
the purpose of this application photos and observes a corporal vision picture, it is making an 
individual's parallax amount adjustment easy. 
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[0021] 

[Means for Solving the Problem]In order to solve an aforementioned problem, a compound eye 
camera of this application has holding mechanism holding a value depending on each photography 
person, and a selecting means as which a photography person chooses a value depending on self 
from said holding mechanism. 

[0022]A control means which a compound eye camera of this application makes control an 
imaging system of a compound eye camera, It makes it possible to make an imaging system of a 
compound eye camera control by said control means based on a value which has holding 
mechanism holding a value depending on each photography person, and a selecting means as 
which a photography person chooses a value depending on self from said holding mechanism, and 
was chosen by a selecting means. 

[0023]A corporal vision observation system of this application is provided with the following. 
Holding mechanism holding a parallax amount depending on each observer of a corporal vision 
picture. 

A selecting means which chooses a parallax amount for which an observer depended on self 
from said holding mechanism. 

A positioning means which determines a position displayed on a display based on a parallax 
amount selected by said selecting means. 

[0024]A compound eye camera or a corporal vision image observation system of this application 
is provided with the following. 

Holding mechanism holding a parallax amount depending on each photography person or an 
observer. 

A setting-out means to set up a present photography person or an observer. 

A selecting means which chooses from said holding mechanism a parallax amount depending on a 

present photography person or an observer set up by said setting-out means. 

[0025]In a compound eye camera of this application, when recording a picture, what a 

photography person also records simultaneously is made possible. 

[0026] 

[Embodiment of the Invention]The example of this invention is described based on a drawing 
below. 

[0027](The 1st example) Draw ing 1 is a figure showing the composition of this example. There 
are the two imaging optical systems 1a and 1b in a compound eye imaging device, and each is 
equipped with the lens 2a, 2b, and CCD3a which is an image sensor and 3b. 
[0028]The picture picturized by the two imaging optical systems 1a and 1b is sent to the signal 
processing part 4, and performs image processing, such as composition of a corporal vision 
picture, picture amendment, a generating picture, here. The signal processing part 4 is connected 
to the object position primary detecting element 5, the finder 6, and the interface 7 for external 
devices. The finder 6 is a device which outputs the picture which carried out picture amendment 
and composition, and the picture by which a corporal vision is carried out can see it using this. In 
editing with an external personal computer etc. or displaying on a display, it transmits to other 
external devices via the interface 7. 

[0029]The setting-out azimuth difference selecting part 9 is connected with the individual 
parallax information accumulating part 10. The parallax value which gives a proper cubic effect is 
put in a database and accumulated in the individual parallax information accumulating part 10 for 
every individual. This database has become like drawing 9, and when a photography person's 
name is chosen, a parallax amount suitable for that photography person understands it The 
setting-out parallax amount in drawing 9 is the value which broke d shown by the conventional 
example by the pitch of CCD, and it is shown what pixel d will be in a picture. Mr. A's setting-out 
parallax amount is 0, and should just set the angle of convergence S to theta like drawing 3 at 
this time. Mr, B's setting-out parallax amount is 10 pixels, for example, if a parallax amount when 
an imaging system is parallel shall be 20 pixels like drawing 2, it should just change the base 
length 1 into V like drawing 4. When a parallax amount is 30 pixels like Mr. E, it can respond by 
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lengthening base length further. 

[0030]The setting-out azimuth difference selecting part 9 chooses from the above individual 
parallax information accumulating parts 10 the parallax amount which gives the present 
photography person a proper cubic effect based on a photography person's name, and sends it 
to the position detecting means 5. 

[0031 ]The user interface used when a user chooses the main object in a corporal vision image 
pick-up display image in the object position primary detecting element 5, The operation part 
which computes an angle of convergence required in order to make azimuth difference of a main 
object into the azimuth difference selected by the setting-out azimuth difference selecting part 
9 from the depth from the imaging optical system of the selected main object is pointed out. 
[0032]Here, specification of one point included in the photographic subject to which its attention 
is paid with pointing devices, such as a mouse, from the picture picturized by the imaging optical 
system of the left displayed on the finder will detect the corresponding points in a right image by 
matching using the template of a certain size centering on the point. The corresponding points of 
this lot can show the azimuth difference in that position, and the depth from [ from that azimuth 
difference ] the position of a main object i.e., an imaging optical system, can be computed. In 
order to make azimuth difference of this main object into the azimuth difference selected by the 
setting-out azimuth difference selecting means 9 r when only an angle of convergence is 
controlled, the quantity of a required angle of convergence is computed. However, the method of 
extracting the main object in a picture automatically [ that the method of choosing the main 
object in a picture only uses a user interface ] is also considered. The main object defines one 
point of the center of a picture beforehand as what exists at the center of a picture, and it is 
also possible to adjust the azimuth difference of the portion. 

[0033]Now, in dr awing 2 , the photographic subject 104 shall be picturized as a candidate for an 
image pick-up of two imaging optical systems. If the photographic subject 104 is chosen in the 
compound eye imaging device of drawing 1 here in the object position primary detecting element 
5, depth z from the center O of two imaging optical systems of the photographic subject 104 
similarly selected in the object position primary detecting element 5 will be detected. 
[0034]The position information on the main object which this object position primary detecting 
element 5 is connected to the imaging optical system drives 8a and 8b, and was acquired here r 
Using the setting-out parallax value from the setting-out azimuth difference selecting part 9, the 
angle of convergence of the two imaging optical systems 1a and 1b is calculated, and it transmits 
to the imaging optical system drives 8a and 8b connected to each. 

[0035]The imaging optical system drives 8a and 8b control the two imaging optical systems 1a 
and 1b based on the amount of angles of convergence transmitted from the object position 
primary detecting element 5. 

[0036]Then, operation of this example is explained using the flow chart of dr awi ng 5. First, a user 
(Mr. A) chooses his name from the individual parallax information accumulating part 10 of the 
display on the finder 6 as shown in drawi ng 10 , and chooses his proper parallax amount Da (=0) 
(SCsetting-out azimuth difference selecting part 9) 51). Next the main object in a picture is 
chosen (S52). This method is automatically performed, using a user interface, as composition 
showed by the way. Then, in the object position primary detecting element 5, the distance from 
the position of the main object in a right-and-left picture, the angle of convergence of the 
present imaging system, and base length to a main object is found, and an angle of convergence 
which becomes Mr. A's proper parallax amount Da is calculated (S53). And this result is 
transmitted to the imaging optical system drives 8a and 8b (S54) r and the imaging optical system 
drives 8a and 8b control the angle of convergence of the imaging optical systems 1a and 1b 

(555) , and photo the corporal vision picture which gives a user (Mr. A) a comfortable cubic effect 

(556) . 

[0037]Here, how to calculate an angle of convergence so that it may become the proper parallax 
amount Da of S53 is described. First, if the interval of L, CCD, and a lens is set to v for base 
length and the pitch of D pixel and CCD is set to p for the azimuth difference of the main object 
at that time when the imaging system at that time is drawing 2, the distance Z to a main object 
will be found by a ** (2) formula. 
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[0038] 

Z=L-v/(D-p) When the base length L and the proper parallax amount of a ** (2) type and the 
distance Z to the main object, and an imaging system are made into Da pixel and the proper 
parallax amount Da is 0 pixel, the angle of convergence Sa of an imaging system is searched for 
by a ** (3) formula, it drives like drawing 3, and the corporal vision picture of the azimuth 
difference 0 is acquired. 
[0039] 

Sa=arctan {L/(2andZ)} When a (3) type and the proper parallax amount Da are not 0 pixel, 
base length La is calculated by a ** (4) formula, it drives like drawing 4, and a desired corporal 
vision picture is acquired. 
[0040] 

La=Z-Da-p/v ** (4) type — here, when a user changes from Mr. A to Mr, B, it can ask for the 
angle of convergence Sb and the base length Lb of the proper parallax amount Db again, and can 
respond. 

[0041 ]By saving the time and effort of changing a parallax amount, and holding an individual's 
proper parallax amount beforehand, while a user looks at a corporal vision picture in this 
example, as it explained [ above-mentioned ]. Also when a photography person changes, it is 
effective in a corporal vision being possible by choosing only a photography person's name by 
the cubic effect which was simply suitable for the photography person. 

[0042](The 2nd example) Drawing 6 is a figure showing the system of the 2nd example. The 2nd 
example is a system which transmits the corporal vision picture photoed with the compound eye 
camera to PC, and performs a corporal vision using PC. A compound eye camera and 62 are 
screens where a PC body and 63 specify a display, 64 specifies liquid crystal shutter glasses, 
and 65 specifies the observer 61 among drawing 6. The compound eye camera 61 photos a 
corporal vision picture like the 1st example, and transmits the picture to PC body 62 via the 
external interface 7 of drawing 1, PC body 62 is outputted to the display 63 so that the corporal 
vision of the corporal vision picture from the compound eye camera 61 can be carried out with 
the liquid crystal shutter glasses 64. 

[0043]How to carry out the stereoscopic vision indication of the first-class corporal vision 
picture in right and left which has azimuth difference mutually here is described. This control is 
performed by using software on PC body 62. This software operates by control of CPU in PC 
body 62. Controller displays are set up first change the first-class corporal vision picture in right 
and left according to a video signal with a vertical scan frequency of 120 Hz. Next, if the corporal 
vision picture from the compound eye camera 61 is outputted to the display 63 alternately with a 
right-and-left picture, a corporal vision picture will be expressed as the frequency which is 120 
Hz on the display 63. The liquid crystal shutter glasses 64 simultaneously connected to PC body 
62 on the other hand are made to penetrate a right eye when displaying a right image on the 
display 63, and when displaying a left image conversely, a signal which makes a left eye 
penetrate is outputted. the liquid crystal shutter glasses 64 receive the signal from PC body 62 - 
- right and left — either is made to penetrate and a corporal vision becomes possible. 
[0044]When performing a corporal vision by such a method, as shown in drawing 8, on the display 
63, a left image and a right image are displayed by turns. The parallax amount of one point P on 
the main object 801 is expressed with the amount of gaps of L point which exists in a left image, 
and R point in the inside of a right image. Although a cubic effect is decided from the parallax 
amount of all the points on a photographic subject, a cubic effect only with a near parallax 
amount of a representative point understands it. 

[0045]The parallax amount of the corporal vision picture from the compound eye camera 61 is a 
quantity suitable for a photography person, and has become a cubic effect suitable for a 
photography person. However, it is changing horizontally the amount of gaps shown above, and it 
is possible to change into a cubic effect suitable for an individual. That is, a cubic effect can be 
changed by controlling horizontally the position which outputs a right-and-left picture by turns. 
For example, if a right-and-left picture is detached horizontally and displayed, and a cubic effect 
will become strong and will bring close and display, a cubic effect will serve as a display which is 
not tiring easily although it is weak. 
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[0046]Then, if the photography person and the observer of a corporal vision picture of a corporal 
vision picture are the same, Although what is necessary is to perform a stereoscopic vision 
indication on the display 63 then, and just to see with the liquid crystal shutter glasses 64, it is 
possible to deal with an individual by changing into a parallax amount suitable for an observer, 
when a photography person differs from an observer, and changing a display position. However, 
when the photography person and observer of a corporal vision picture differed from each other, 
the setting out needed to be performed each time. Then, as shown in Screen 65 which specifies 
the observer of drawing 6 in this example, The parallax amount suitable for the observer who 
observes a corporal vision picture beforehand is held, and photography person data is also 
inputted with a corporal vision picture from the compound eye camera 61 , a photography person 
is compared with an observer, if they differ, a display position will be calculated, and with a 
parallax amount suitable for an observer, it displays so that a corporal vision may be possible. 
[0047]Then, operation of this example is explained using the flow chart of drawing 7. At Step 
701, a corporal vision picture and photography person data are inputted from the compound eye 
camera 61. At Step 702, a parallax value suitable for the photography person is read from the 
photography person data by which human power was carried out. This has a database which 
consists of the name and proper azimuth difference like drawi ng 9 shown in the 1st example, and 
can acquire the proper parallax value of the photography person of a corporal vision picture by 
using the database. At Step 703, an observer is chosen like drawing 6 and a parallax value 
suitable for an observer is read from a database like Step 702. In Step 704, a parallax value 
suitable for a photography person is compared with a parallax value suitable for an observer, and 
if the same, based on the parallax value, it will express on the display 63 as Step 706. It 
calculates in order to change the display position of a picture so that it may become the parallax 
value which was suitable for the observer at Step 705 when it differs, and it displays on the 
position which the display 63 changed at Step 706. 

[0048]when setting to dl the parallax amount which was suitable for dt and an observer in the 
parallax amount suitable for a photography person, change of the display position of the picture 
in Step 705 calculates dt— dl, and shifts it to the part inside (in a negative case, it shifts outside) 
— it carries out by changing like. 

[0049]By this example, as shown above, even when the photography person and the observer of 
a picture of a corporal vision picture differ from each other, it becomes possible to adjust a 
cubic effect easily, and is effective in a corporal vision picture being observable by a cubic effect 
suitable for an observer. 

[0050]Although this example explained the parallax amount of one point on a main object, this is 
because a main object usually exists most in this side in a picture. It is more effective to adjust 
the parallax amount of what exists most in this side, as soon as it adjusts the parallax amount of 
a main object, when it is effective to double with an observer's liking the parallax amount of the 
photographic subject which exists before the first person in a picture in our examination, and a 
main object does not exist most in this side. 

[0051]Although this example explained the time of transmitting the corporal vision picture 
photoed with the compound eye camera to PC, it is effective, also when holding the corporal 
vision picture photoed in the memory in a compound eye camera and observing that corporal 
vision picture on the corporal vision display on a compound eye camera. When observing a 
corporal vision picture on a display, photoing a corporal vision picture, as the 1st example 
explained, a photography person is chosen, and an angle of convergence and base length are 
controlled. It is also effective like the 2nd example to change an image output position instead of 
base length control at this time. It is effective in photography and observation of a good cubic- 
effect picture being possible only by choosing a photography person (observer), also when such. 
[0052] 

[Effect of the Invention] As explained above, according to the 1st invention concerning this 
application, it is effective in the ability to set up the value for which the photography person 
depended on self easily. 

[0053]According to the 2nd invention concerning this application, the value for which the 
photography person depended on self easily can be set up, and it is effective in an imaging 
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system being controllable based on the value. 

[0054]According to the 3rd invention concerning this application, the parallax amount for which 
the photography person depended on self easily can be set up, and it is effective in an imaging 
system being controllable based on the parallax amount. 

[0055]According to the 4th invention concerning this application, the parallax amount for which 
the observer depended on self easily can be set up, and it is effective in the ability to acquire a 
cubic effect suitable for an observer. 

[0056]According to the 5th invention concerning this application, the parallax amount for which it 
depended on self easily can be set up only by setting up a photography person or an observer, 
and there is flume ******. 

[0057]According to the 6th invention concerning this application, when recording a picture, a 
photography person is also effective in it becoming easy to use the database depending on a 
photography person by recording simultaneously. 
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